Sharp utilization thresholds for some 
real-time scheduling problems 

Sathish Gopalakrishnan 
Department of Electrical and Computer Engineering 
The University of British Columbia 

Abstract 

Scheduling policies for real-time systems exhibit threshold behavior that 
is related to the utilization of the task set they schedule, and in some cases 
this threshold is sharp. For the rate monotonic scheduling policy, we show 
that periodic workload with utilization less than a threshold U^j^^ can be 
scheduled almost surely and that all workload with utilization greater than 
is almost surely not schedulable. We study such sharp threshold be- 
havior in the context of processor scheduling using static task priorities, not 
only for periodic real-time tasks but for aperiodic real-time tasks as well. 
The notion of a utilization threshold provides a simple schedulability test 
for most real-time applications. These results improve our understanding of 
scheduling policies and provide an interesting characterization of the typ- 
ical behavior of policies. The threshold is sharp (small deviations around 
the threshold cause schedulability, as a property, to appear or disappear) for 
most policies; this is a happy consequence that can be used to address the 
limitations of existing utilization-based tests for schedulability. We demon- 
strate the use of such an approach for balancing power consumption with 
the need to meet deadlines in web servers. 



1 Introduction 

Computing systems have become larger in scale and more pervasive in their ap- 
plications. The constant interaction between embedded computing systems and 
the physical world requires a notion of predictable behavior from the deployed 
computing systems. Even in large-scale computing clusters and server farms 
there is a growing emphasis on providing service guarantees. This need for pre- 
dictable operation can often be characterized by a need for timely completion 
of activities. Tasks can usually be associated with deadlines; systems need to 
ensure that the tasks meet their deadlines. 

In a sense, the convergence of computation, communication and control, 
which is often seen in distributed embedded systems, has led to a renewed in- 
terest in understanding the conditions for a system to meet deadlines. Addition- 
ally, most tasks are recurring: they need to be performed repeatedly because of 



the constant interaction with the physical environment (or because of user de- 
mand). Such problems have been at the heart of real-time scheduling since the 
seminal work by Liu and Layland [23] on utilization bounds for schedulability 
using static and dynamic priority scheduling policies. 

Liu and Layland considered a set of periodic tasks with known execution 
times and periods that need to be scheduled on a uniprocessor system. Each task 
T, was characterized by its execution time c, and its period P,. In the periodic 
task model, if an instance of task t, is eligible for execution at time t, the next 
instance of the same task is eligible for execution at time t + Pi. Each instance of 
a task is called a job. Liu and Layland restricted their analysis to task sets where 
each job needs to complete before the next job belonging to the same task is 
ready for execution. For task t,-, each job needs to complete execution within 
Pi time units after its release. Hence P, is known as the relative deadline for 
the task. It is easy to see that each task will use the processor for a ^ fraction 
of time. This fraction is the utilization of task t, and can be denoted The 
utilization of a task set, therefore, isU = Y!i=i «i where n is the number of tasks. 

The fundamental contribution that Liu and Layland made was to show that 
for a specific scheduling policy ^ - they studied the Rate Monotone policy and 
the Earliest Deadline First policy - there exists a utilization bound such that 
any task set with utilization f/ < f/^ is definitely schedulable (all deadlines will 
be met) . This has formed the basis for much work in real-time systems. 

There are, however, some obvious limitations to Liu and Layland's result. 
The first drawback is that the utilization bound test is pessimistic: there are 
many task sets that may exceed the bound but are still schedulable. Second, for 
models when the relative deadline does not equal the period, additional tests 
are needed. Lastly, obtaining the utilization bound is difficult for many policies 
because such derivations involve identifying the worst-case task set (the task 
set with low utilization that is not schedulable) and this is non-trivial for certain 
policies. 

In contrast with prior work on schedulability and predictability, we show 
that the rate monotonic scheduling policy has a utilization threshold C/^^ such 
that any task set with utilization less than U^j^ is almost surely schedulable and 
a task set with utilization greater than C/^^ is almost surely not schedulable. 
Similarly, we show that such a threshold exists for deadline monotonic schedul- 
ing of aperiodic real-time tasks. Establishing the sharpness of utilization thresh- 
olds provides a better understanding of scheduling policies and removes most 
of the pessimism that is associated with traditional utilization bounds because 
of the implication that task sets with utilization greater than U* are unlikely 
to be schedulable. These results are independent of the relationship between 
task periods and task deadlines. On the other hand, it is prudent to note that 
these results indicate that schedulability appears and disappears almost surely. 
For hard real-time systems, which cannot afford to miss any deadlines, this sug- 
gests that the threshold can be used as an initial estimate and schedulability 
needs to be verified by an exact test at some step. For soft real-time systems, 
which can tolerate some deadline misses, our results provide a simple test and 
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a tight performance guarantee. 

As an example, consider rate monotonic scheduling with the Liu and Layland 
task model. We would like to show that when n, the number of tasks to schedule, 
is large, almost surely task sets of utilization less than about 0.80 utilization are 
schedulable and almost surely task sets with greater utilization are unschedu- 
lable. This shows that the average performance of the rate monotonic policy 
is much better than the Liu and Layland worst-case utilization of 0.69 [23|. It 
is exactly for the case of large task sets that other analysis techniques become 
computationally expensive. The fundamental contribution we make is a frame- 
work for answering questions about average or typical case schedulability. To 
date there has been no unified methodology that can deal with all scheduling 
policies. 

In this article, our emphasis is on rate monotonic scheduling for periodic 
tasks and deadline monotonic scheduling for aperiodic tasks on a uniprocessor 
although some preliminary experiments lead us to believe that these results 
should hold for multiprocessor and distributed (multistage) systems as well. 

Motivation. The main reason for studying sharp thresholds is to ease re- 
source provisioning for soft real-time systems, and, in some cases, simplify the 
offline optimization of hard real-time systems. The existence of sharp thresholds 
allows us to make efficient use of computing resources. Many mainstream op- 
erating systems (especially Linux) support simple fixed-priority scheduling and 
being able to identify a workload limit for such systems allows for simple ad- 
mission control and resource management. Many applications have tasks with 
deadlines but are built to tolerate a few deadline misses. Multimedia applica- 
tions have been traditional examples, but many emerging pervasive computing 
applications are of a similar nature. Timely response leads to high quality of 
service but occasional delays are not catastrophic. For these systems, being able 
to utilize resources better can lead to substantial cost savings that will allow 
these applications to achieve greater market penetration. It can be argued that 
feedback control [I25II can keep soft real-time systems in an acceptable operation 
regime but such techniques may require substantial modifications to operating 
systems and/or middleware platforms. Additionally, our findings may allow 
feedback control schemes to pick better set points. 

In the next section (Section |2]), we elaborate on the model for periodic real- 
time tasks that we consider and the notation we will follow. Then, in Sections [s] 
[4] and [5} we will develop the framework for reasoning about average-case be- 
havior and present proofs of our key results. We will then followup with experi- 
mental evidence and discussion of the results (Section[6]). We then extend these 
results to the aperiodic task model and demonstrate the use of sharp threshold 
behavior in power control for web servers (Section [?]). Finally, we place our 
work in context with related work (Section [s) and conclude the article (Sec- 
tion [9]). 
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2 System and task models 



We consider a general and well-understood model for uniprocessor scheduling. 

Platform model. We consider a uniprocessor system that can schedule tasks 
using static priorities and preempt (suspend execution of) tasks to schedule 
tasks with higher priority. 

Task model. Each task t, is periodic with period P, . Each instance of the task 
has an execution time requirement c, on the processor and a relative deadline 
Di = Pi. If a job of T, is released (ready for execution) at at time t then it is 
expected to finish execution by time f +/",-. Tasks are independent of each other 

The typical assumption is that the first instance of all periodic tasks release 
at the same instant in time. A reason for making this assumption is that this 
represents the worst-case situation for static priority policies. We will also make 
this assumption although it is not strictly necessary. 

The utilization of a periodic task set is 

u:=y-. 

Monotone scheduling policies. In this article, we will mostly be concerned 
with the rate monotonic and deadline monotonic scheduling policies, which are 
work-conserving (non-idling) policies. It is also useful to keep in mind a more 
general classification of policies: the class of monotone policies. Let us suppose 
that a scheduling policy successfully schedules a set of tasks T = {t,}. We will 
call the policy a monotone scheduling polic^ii and only if: 

• It can schedule any set A c F successfully; 

• For any task t, e F, the policy can schedule all tasks successfully if c, were 
to be reduced; 

• For any task t, e F, the policy can schedule all jobs successfully if Pi were 
increased. 

3 Utilization thresholds 

Let F be some task set. We define v(t/,F) as the probability of selecting task 
set F from all possible task sets of utilization U. Let 5„ represent the set of all 
schedulable task sets with n tasks. Then n{U,S„) := T^reSn^i^^^) represents 
the probability that a task set with utilization U„ is schedulable using the rate 
monotonic policy. This can also be stated in the following manner Suppose F, 
a task set with n tasks, is drawn at uniformly at random from the space of all 
possible task sets of utilization U„. Then, ii{U,S„) is the probability of the event 
"Fe5„." 

^Note that there is a distinction between this notion of monotonicity and the use of the term 
"monotone" in the context of rate/deadline monotone priority policy. However, by this definition, 
the rate monotonic scheduUng poUcy and the deadline monotonic scheduling policy are monotone 
scheduling pohcies. 
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Definition 1 (Threshold) U* is said to be a threshold for S„ if for any U 



Note that f means f/g^Q. 

The definition of threshold may appear trivial in the case of scheduling poli- 
cies (clearly utilization of is schedulable, and utilization > 1 is unschedulable) 
and hence we require a stronger criterion for a useful threshold. 

Definition 2 (Sharp threshold) A threshold is said to be sharp if there exists a 
U* such that for every e > and any U 



The interval of width 2e over which the probability of finding a valid sched- 
ule drops from 1 to is called the threshold interval. As « ^ oo, the threshold 
interval becomes arbitrarily small and we have a sharp threshold. 

A threshold that is not sharp is a coarse threshold. Sharp thresholds repre- 
sent phase transition phenomena because we can divide the task set space into 
two phases: one in which the property holds almost always and one in which it 
almost always does not hold. 

We emphasize once more that, although the results are as5Tnptotic, in prac- 
tice a reasonable number of tasks suffices for observing sharp thresholds. When 
we think of n — > oo, we do not conjure up task sets with 1000s of tasks; we are 
usually dealing with many 10s of tasks. 

The main result of our work is that schedulability, with the rate monotonic 
scheduling policy, of periodic tasks has a sharp threshold. 

By proving such a result we provide a platform for the average-case analysis 
of real-time scheduling problems and highlight the validity of using empirical 
utilization thresholds for managing resource allocation. 

4 Schedulability as a graph property 

To show that scheduling problems of the type that we are interested in have 
a sharp threshold we will gain leverage from work carried out in the context 
of random graphs. The study of phase transitions can be traced back to the 
work of Erdos and Renyi on random graphs Il9l IIOB . A random graph is a graph 
with a fixed set of vertices and edges between two given nodes occur with some 
probability, p. Erdos and Renyi showed that as the parameter controlling the 
edge probability varies, the random graph system experiences a swift qualitative 
change. This transition is similar to observations in the physical world. Akin to 
water freezing abruptly as its temperature drops below zero, the random graph 
changes rapidly from having many small components to a graph with a giant 
component that contains a constant proportion of vertices. 




(1) 




(2) 
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We will use results that have been obtained by Friedgut and Bourgain Ullll to 
prove the existence of a sharp utilization threshold for schedulability. The first 
step is, of course, to connect the scheduling problem to a problem on graphs. 

To consider scheduling as a graph problem, v^fe v^fill first deal v^fith utilization 
in a quantized fashion. Let q be the smallest quantum of utilization that can be 
allocated to a task. Each task can have a utilization of at most 1 therefore there 
are at most M — \/q quanta, and M is assumed to be sufficiently large. More 
specifically, given n tasks, without loss of generality, M can be of the form (^2)" 
for some constant ki > 2. If m, is the utilization of task t,- and P,- is the period of 
the task, then c, = m,7^. We can thus represent each periodic task by the tuple 

Consider a bipartite graph with the two vertex partitions being ,3^ and 
The vertices in ,3^ represent tasks and each vertex can be labeled by its period. 
(The periods, as can be expected, are assumed to be chosen uniformly at ran- 
dom from the space of all possible periods.) The set contains M vertices, each 
corresponding to one quantum of utilization. The complete bipartite graph with 
,3^ and ^ as the two partitions represents a task set with each task having uti- 
lization 1 . This is clearly unschedulable for task sets with more than one task. 
If edges are present with probability p then we have random task sets with an 
expected utilization of Mnp where n is the number of tasks. By choosing the 
value of p appropriately, we can generate random task sets with varying uti- 
lization levels. There is a graph corresponding to each task set and we will call 
these graphs task set graphs. In turn, for each utilization level, there is a cor- 
responding edge probability p (The complete bipartite graph representation is 
illustrated in Figure[T]). The set of periods is a set of integers. For n tasks, there 
may be at most « periods chosen from a range of integers. When « is large, we 
can represent all possible periods using such a graph. 



y M quanta 



J 

V y 

Complete bipartite graph. 
Each edge exists with 
probability p. 

Figure 1 : Task set graph 

^The use of quantized utilization does not limit our analysis in any way; M can be made suffi- 
ciently large to approximate real allocations. 
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Figure 2: Unschedulable task set graph 



Certain combinations of periods and execution times lead to unschedulable 
task sets under the rate monotonic scheduling policy (Figure [2] depicts a task 
set of utilization 0.97 that cannot be scheduled using the rate monotonic policy. 
This task set has two tasks: one with period 10 and utilization 0.8 and another 
with period 18 and utilization 0.17.). This phenomenon is well understood from 
the initial study by Liu and Layland |23|. These unschedulable task sets are 
subgraphs of the complete bipartite task set graph. Increasing p from to 1 
leads to unschedulable task sets. There is, in fact, a critical edge probability, p*, 
which in turn corresponds to a critical utilization U* for (un)schedulability. For 
p < p*, the expected task set is asjTnptotically almost surely schedulable; for 
p > p* , the expected task set is as5Tnptotically almost surely not schedulable. 
The next section details the proof of this sharp threshold behavior 

Remark. In our description of the graph model, we assumed that edges in the 
task set graph exist with probability p, which would imply that only the average 
utilization is fixed. We can invert the model by fixing the number of edges. 
This does not alter the probability of an edge existing between two vertices but 
ensures that the utilization (and not just the average utilization) is fixed. 



5 Sharpness of utilization thresholds 

The scheduling graph provides a structure to study the typical (or average) 
case behavior of scheduling problems. Given a utilization level, each edge in 
the graph appears with a certain probability that captures typical scheduling 
problems. 

Scheduling problems do exhibit threshold behavior and that this behavior is 
controlled by the utilization of the set of tasks to be scheduled. To be convinced, 
it should suffice to remark that when utilization is all task sets are schedulable, 
and for utilizations above 1 no task set is schedulable. The primary question 
then becomes: "Is the threshold sharp or is it coarse?" To answer this question 
we will need further results. 
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5 . 1 Preliminaries 



We will apply a theorem obtained by Bourgain that appeared as an appendix 
to Friedgut's article [illl . Recall that {0, l}'^ is the set of all A^-bit vectors and 
that any x e {0, l}'^ is an A^-bit vector We can use these vectors to indicate the 
presence of edges in a graph v^fith at most edges. The size of such a vector x, 
denoted \x\, is the number of Is it contains. 

Let V — {0, 1}^ and let W be some subset of V that represents a graph prop- 
erty. In our discussion, it v^rill be useful to consider V to be the collection of 
all possible task set graphs and W to be the collection of unschedulable task 
set graphs. When the vertex partitions J' and are known, then the task set 
graph is defined by its edges. If is the maximum possible number of edges, 
then every element of V, i.e., an A^-bit vector, represents a task set graph. 

The general definition of a monotone property follows, where x and y are 
elements of V and can also be treated as vectors; x, is the element of the 
vector X. 

Definition 3 (Monotone property) W CV is said to be monotone if and only if 

In the context of graphs, a monotone property is one that cannot be de- 
stroyed by the addition of edges. 

If a task set is unschedulable using the rate monotonic policy, then increas- 
ing the utilization of any of the tasks, which adds edges to the corresponding 
task set graph, will also result in an unschedulable task set. The monotone 
graph property of interest to us is that collection of edges that makes a task set 
unschedulable. (Adding edges to a graph representing an unschedulable task 
set will result in another unschedulable task set graph.) 

In the theorem that follows, the term ^p(A) is the probability that a graph 
property A is present if each of the A^ edges is chosen with probability p. If x 
represents a graph, and if x,- is 1 when edge / is present in x and is otherwise, 
then 

Mp(A):=^/l(l-/,f-W. 

xeA 

Theorem 1 (Bourgain Ullll ) Let A c {0, l}'^ be a monotone property and as- 
sume say 

(Al): ^ip{A)^h (3) 
(A2): p'^KC, (4) 
(A3): p^o{l). (5) 

Then there is a 5 ^ f{C) for some function f such that at least one of the following 
two conditions must be true: 

CI: 

jXp{x e {0, l}"|x contains x e A, \x \ < IOC) > 5 (6) 
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C2: There exists x' ^ A of size \x'\ < IOC such that the conditional probability 

^p{x£A\xDx')>^ + 5. (7) 



/(n) e o{g{n)) is equivalent to stating that lim„^oo = 0. The edge proba- 
bihties are functions of A^, the maximum size of the graph, and are expected to 
diminish as increases. This is captured as p = o(l), to indicate that p <C 1. 

Some comments about Bourgain's theorem are now in order Bourgain's 
theorem, in essence, states that if a monotone property is such that p^ <C 

then that monotone property is approximated by a "local property']^ In a graph, 
a local property is a property that depends on a small number of vertices and 
edges. Bourgain proved that if is bounded by some constant, then there 

must exist some small graphs (whose sizes are bounded by a constant) that are 
capable of boosting the probability of the desired property appearing, x' is such 
a booster Inequality (|6]) suggests that most graphs that possess the monotone 
property in fact contain a subgraph that satisfies the property. Inequality ([7]) is 
equivalent to saying that for some graph y c {0, l}'^, the probability that y Ux' 
is in A is at least 1/2 + 5. 

We shall explain this result using the Erdos and Renyi model for random 
graphs. In this model, each of the possible (2) edges in a graph with m vertices 
is added with probability p. The property that the random graph is connected 
is not a local property because it involves all the vertices in the graph. On the 
other hand, the property that the random graph contains a triangle is local be- 
cause a triangle has only 3 vertices. It is for this reason that connectivity has a 
sharp threshold [91 but the existence of a triangle has a coarse threshold [ TTH . 
A sharp threshold is associated with a rapid change in the appearance or disap- 
pearance of a property, which means that ^ 00 when ^p(A) = i. When a 
threshold is coarse, this derivative (or slope) is finite. A vital point to note is 
that < C is definitely true for all coarse thresholds and may be true for 

some sharp thresholds. On the other hand, ^ °° holds only for sharp 

thresholds and is a stronger characterization of certain sharp thresholds. For 
schedulability we will show that this stronger result holds. To do so, we will 
show that schedulability depends on a non-local property of the schedulability 
graph. We also add that jUp(A) is continuous and its derivative exists: every 

Lemma 1 For a set of n periodic tasks with periods Pi,... ,Pn, the minimum uti- 
lization for a task set that is barely schedulable using the rate monotonic policy is 
achieved only when all n tasks have specific execution times. As a result, any task 
set that is unschedulable will have at least n edges. 

Proof From Liu and Layland's proof [12311 . the task set with minimum uti- 

■^Friedgut proved a similar result except that Friedgut's approach required that the random struc- 
ture under investigation exhibit some symmetry | llj . 
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lization that is barely schedulabl^ is such that c, — ~ Pi^i € {l,n— 1}, 

c„ — P„ — 2{ci -\ l-c„_i), and P„ > f„_i > • • • > Pi. Because utihzation of the 

barely schedulable task set is minimized only when all tasks have non-zero ex- 
ecution times, the task set graph has at least « edges for the barely schedulable 
task set. A task set that is unschedulable has to have a higher utilization and 
hence the corresponding task set graph will also have at least n edges. 

□ 

5.2 Main result 

Theorem 2 The schedulability of a task set with n periodic tasks, where each task 
T, is characterized by execution time Ci, period Pi, and relative deadline equal to 
its period, has a sharp utilization threshold. The utilization of the set of tasks is 

Proof Consider the task set graph that represents the (un) schedulability 
of a task set with n tasks when each edge occurs with probability p and the 
corresponding utilization level is Mnp. A task set is unschedulable if and only 
if the corresponding task set graph includes an assignment of utilizations to 
periods that causes deadline misses. We need to show that there is some p*, 
and hence some U* = Mnp*, that is a sharp threshold. 

Let A represent the property of a task set graph containing an unschedulable 
assignment of utilizations to periods. Choose a p such that Hp{A) — j. We can 
always find such a p because we know that all task sets are schedulable when 
utilization is and no task set is schedulable if its utilization exceeds 1 . 

lip[A) is a polynomial in p and is differentiable with respect to p. Let us 

suppose that p^%^ < K/\Q. It is also the case that p < l/Mn and hence p = 

0(1). 

We will assume that the set of possible edges is E. From Bourgain's the- 
orem (Theorem [l]) we know that if all the conditions are true (especially the 
constraint on p'^^^§^) then there must exist some x' such that 

^p(jce {0, l}l^l)|x contains jc' e Ajjc'l <K)>5 (8) 
or there exists x' ^ A of size |x'| <K such that the conditional probability 

l^p{xeA\xDx')>^ + 5 (9) 

for some 5 = f{K). 

From Lemma [T] we realize that at least n edges are required in the task set 
graph to make a task set unschedulable. Task sets that are unschedulable at 

'^A barely schedulable task set is one that fully utilizes the processor for an interval of time that 
begins with the arrival of an instance of some task and extends at least up to the deadline of that 
task instance. 
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higher utiHzation levels (higher than the unschedulable task set with minimum 
utilization) will have more edges in the task set graph. This observation helps 
us eliminate the possibility of an x' e A of constant size because the size of the 
minimal unschedulable task graph increases as we increase the number of tasks. 
In other words, inequality (|8]) does not hold. 

Inequality ([9]) cannot be true because that would imply that even assigning 
a very small utilization to certain tasks is bound to increase the probability of 
unschedulability by an additive constant. Let us assume that K edges exist a 
priori in a task set graph. By Lemma[T] we know that at least « edges are needed 
for an unschedulable task graph, and each task (period) should receive at least 
one edge. The conditional probability that each task (period) gets at least one 
edge given that K edges exist a priori and have been assigned in the best possible 
way (an edge each to K periods) is still dependent on the total number of edges, 
M, which is greater than n. Thus the influence of a constant number of edges in 
the task set graph can not increase the probability of inducing unschedulability 
by a constant d — f{K). 

When both inequalities ([8]) and ([9]) do not hold, by a contrapositive argu- 
ment, we cannot have p '^^^^^ < K/IO. (The other two prerequisites for Bour- 

gain's theorem are definitely true.) Since is not bounded, we conclude 

that schedulability has a sharp threshold. 

□ 

The structure of the proof above is that, for task set graphs, premises (Al) 
and (A3) from Bourgain's theorem (Theorem [l]) hold and conditions (CI) and 
(C2) are false therefore (A2) must be false and indicates a sharp thresh- 

old. 

With edge probabilities being related to the utilization U, we can also use 
the term ^f/(A) to represent the probability that a task set with utilization U is 
schedulable. 

Remark 1 (Width of the threshold interval) As n ^ oo, the sharp threshold the- 
orems indicate that the transition will be swift and going past the threshold will 
cause an immediate change in the ability to find the property of interest. For mod- 
erate values of n, it is possible to obtain some understanding of the swiftness of the 
transition. The width of the threshold interval is the smallest difference U1—U2 
such that fiu^ (A) = e and jUf/2(A) = 1 — efor a fixed e,0 < e < 1/2. The width ap- 
pears to be related to the number of permutations that are possible on the random 
structure. For the scheduling graph, the valid permutations correspond to permu- 
tations of the task set, i.e., among the n tasks. Based on the work by Friedgut and 
Kalai (see Section 5 of their article 1121 ). we conjecture that for a task set with n 
tasks, the width of the threshold interval is 0{^). 

Remark 2 (Location of the threshold) Given a finite (but large) number of op- 
tions for task periods, we have shown that there exists a sharp threshold for rate 
monotonic scheduling. The location of the threshold does depend on the number 
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of tasks and the task periods. When the number of task periods are large, and not 
chosen pathologically, the location of the sharp threshold indicates good processor 
utilization. 



6 Empirical results and discussion 
6.1 Threshold behavior 



n=16 
n=32 
n=64 



Si 



0»* 



0.1 0.2 0.3 0.4 



0.6 0.7 0.8 0.9 



(a) Task sets generated using the UUniSort method (6l 




0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 
Utilization 



(b) Task sets where each task had the same utilization 
Figure 3 : Thresholds for rate monotonic scheduhng 

Having established that rate monotonic scheduling has a sharp threshold, 
we use experiments to locate the threshold and to observe the sv^fiftness of the 
transition from schedulability to unschedulability. A closed-form solution for 
the threshold has been elusive, and empirical evidence is our resort. 



12 



when examining experimental data, it behooves us to recall that sharp 
threshold behavior is a property of large task sets. For moderate size task sets, 
one can observe a threshold but it may not be as sharp as one would expect. 
(We present only a limited number of graphs for space considerations. Given 
the immense number of graphs that can be obtained, those shov^fn here are in- 
tended as a visual cue to the theoretical machinery we have used. The results 
presented here suggest that task sets of nominal sizes have a usable threshold.) 

Bini and Buttazzo [6| have studied different approaches to generating ran- 
dom task sets and have suggested methods with (almost) no bias. The goal of 
Bini and Buttazzo's work was to generate task sets uniformly at random from the 
space of all possible task sets that achieve utilization U. We employed the UU- 
NiSORT procedure from the article by Bini and Buttazzo Il6l. Periods were then 
drawn uniformly at random from [1 , 10^]. Task set utilization was varied in steps 
of 0.1 and at each level we tested 10'* task sets. The different numbers of tasks in 
a task set for the experiments were 8, 16,32 and 64. Notice (in Figure[3](a)) that 
schedulability drops rapidly when utilization is in the range [0.8,0.9]. The width 
of the threshold interval is smaller for larger task sets. Within a rather short 
interval, we go from almost all task sets being schedulable to almost no task set 
being schedulable. This transition allows us to approximate the schedulbility 
test by using a utilization threshold near 0.8. 

We also conducted another experiment where we generated task sets that 
had the same utilization for each task: in other words, the total utilization 
was divided equally among all tasks. This experiment is informative because 
critically schedulable task sets for rate monotonic scheduling have this prop- 
erty Il23l 161. The results of this experiment reveal (Figure [3|^b)) that when 
period values are arbitrary the achievable utilization is significantly higher than 
tight utilization bounds and that the threshold between schedulability and un- 
schedulability is sharper 

The sharp utilization threshold result appears remarkable because it makes 
no assumptions about task periods and yet provides quite a precise estimate of 
schedulability. The general methodology for deriving utilization bounds for any 
scheduling policy involves identifying a task set that achieves low utilization 
and is yet unschedulable. It is not always easy to isolate the worst-case task set 
and determine its utilization. A major payoff from Theorem [2] is the ability to 
obtain thresholds empirically. When the worst case is rare (a low probability 
event) we are not burdened with a low utilization bound. 

A possible concern is the asymptotic nature of the result. Sharp threshold 
behavior occurs when the number of tasks is large. We contend that this is 
exactly the case for which existing real-time scheduling results are often ineffi- 
cient (high complexity for analysis). As experiments reveal, a moderate number 
of tasks is sufficient for observing sharp thresholds. For small task sets, even 
exact tests may be performed very quickly. There is a dependency between the 
threshold and the number of tasks. It is easily possible to compute - offline - the 
threshold for different numbers of tasks and utilize the appropriate threshold. 

The use of thresholds becomes extremely useful in the case of soft real- 
time systems and for performing fast exploration of design space in developing 
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(near-) optimal systems. An example is radar dwell scheduling [|13[ 1151 [T4ll . 
There are many task parameters that need to be tuned in a radar system to min- 
imize tracking error subject to schedulability but the scheduling algorithms are 
hard to analyze; using thresholds for these problems simplifies the online opti- 
mization. Because performance is controlled at run-time, optimization routines 
cannot invoke exact tests that have high time complexity. Apart from online 
optimization, thresholds can be used as offline guidance measures to improve 
system designs. 



6.2 Some comparisons 

In our work, we make no assumptions about the task periods and execution 
times: they can be arbitrary. There has been work by Park, Natarajan and 
Kanevsky [28 | and Lee, Sha and Peddi [19 | obtained good utilization bounds 
by using task periods alone; execution times of tasks were unknowns in their 
approach. To determine if there is an improvement in coverage due to sharp 
threshold behavior, we assumed that tasks are restricted to periods in the set 
{3,8, 11, 16,20,42, 120,300}; this set of periods has a utilization upper bound of 
0.88 using the technique of Lee et al. |]19l| . Generating tasks as we did earlier 
(using the UUniSort approach), we found that the sharp threshold is about 
0.94, which is a 6% improvement in utilization compared to the utilization up- 
per bound obtained (Figure [4]). Techniques that use period information to ob- 
tain utilization bounds are effective but sharp threshold behavior allows us to 
be more aggressive even when period information is available. These results 
also indicate that sharp thresholds do exist even if periods are drawn from a 
restricted set. 



Periods=[3,8,l 1,16,20,42,120,300] 



0.05 0. 1 0. 15 0.2 0.25 0.3 0.35 0.40.45 0.5 0.55 0.60.65 0.7 0.75 0.8 0.85 0.9 0.95 
Utilization 



Figure 4: Thresholds with known periods 
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7 Aperiodic workload and web server QoS 



So far we have discussed rate monotonic scheduling of periodic tasks. In this 
section we extend the sharp threshold result to the aperiodic task model and 
highlight an application of this idea to the improved power management in 
delay-sensitive web services. 

7. 1 Threshold for static-priority scheduling of aperiodic tasks 

We can look beyond periodic tasks and consider tasks that do not have a strictly 
periodic arrival pattern. Such a model has been investigated by Abdelzaher, 
Sharma and Lu [1 1 who derived synthetic utilization bounds for task sets where 
the execution times and relative deadlines for tasks are known. We can extend 
the theory of sharp thresholds to the case of aperiodic tasks easily. In this section 
we will establish that the schedulability of aperiodic tasks using the deadline 
monotonic priority policy has a sharp threshold and we will use this fact to 
improve on a power management scheme for web servers that was suggested 
by Sharma et al. [30]. 

A job / in an aperiodic task model has an arrival time a,-, an execution time a 
and a relative deadline D, (the absolute deadline is Oi+Di). Abdelzaher, Sharma 
and Lu define the synthetic utilization mj of the set of active tasks at time t as 

active tasks ' 

where the set of active tasks at time t is the set of tasks that were released at 
or before time instant t and whose absolute deadlines are not earlier than t, 
i.e., a, < t and Oi+Di > t. If the synthetic utilization never exceeds a synthetic 
utilization bound, U/,, then all jobs are guaranteed to meet their deadlines fll] 
O . If n is the maximum number of instances that can be active at any given 
time instant, we can show that there must exist a threshold U* such that task 
invocation patterns with t/(f ) < (1 — e)U* are schedulable almost surely and task 
invocation patterns with U{t) > (1 + e)U* are not schedulable almost surely as 
n — > oo for any e > 0. 

It is useful to maintain a notion of job streams, which we will now define. 

Definition 4 An aperiodic job stream is a set of jobs where each job has the same 
execution time and relative deadline and job J precedes job k in the job stream iff 
cij + Dj < a^. 

Essentially, only one instance of each job stream is active at a given time instant 
t. 

Theorem 3 The schedulability of aperiodic task streams, where each task stream 
T, is characterized by jobs with execution time a and relative deadline Di, has a 
sharp synthetic utilization threshold. The synthetic utilization at any time t is 

£/(0<lLi ^■ 
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The proof for the existence of a sharp threshold for deadHne monotonic 
scheduHng of aperiodic jobs does not require much deviation from the proof 
of the existence of a sharp threshold for rate monotonic scheduling of periodic 
tasks. The only modification that is required is to replace the vertex partition 
9' with vertices that abstract most characteristics of an aperiodic job stream. 
Let each vertex in this partition represent a stream v^rith relative deadline Z),- 
and a sequence of arrival times for that stream of jobs. In our analysis of pe- 
riodic tasks, the period of a task v^fas sufficient information to associate v^fith 
each vertex. If v^fe limit the arrival times to be integers in the interval (0, T\ for 
some integer T , we have a finite number of such vertices in 3' . As T ^ oo, the 
number of vertices in n-^ °°. n is the number of job streams and hence is 
the maximum number of active jobs at any time instant. We can then use the 
same mechanism as before, with the task set graph, to show that a sharp thresh- 
old must exist for deadline monotonic scheduling because deadline monotonic 
scheduling satisfies the monotonicity property. To further confirm this knowl- 
edge, we generated many random instances of the aperiodic task scheduling 
problem and determined if jobs missed their deadlines. For these experiments, 
we had a varying number of job streams with the inter-arrival time for each job 
stream being drawn from an exponential distribution. The maximum synthetic 
utilization contribution of any one job stream (the maximum value of ci/Di) 
was kept at 0.125 to allow for a sufficient number of streams. This is a modest 
assumption given that we would like to demonstrate the use of sharp thresholds 
to control the power consumption of a web server dealing with many (100s to 
1000s) small jobs. 

1 

0.9 
0.8 
0.7 

i 

0.3 
0.2 
0.1 
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Figure 5: Threshold for deadline monotonic scheduling of aperiodic tasks 

The graph illustrating sharp threshold behavior for aperiodic task scheduling 
(Figure |5]) indicates that the threshold for deadline monotonic scheduling may 
be close to 0.8, which is substantially higher than a synthetic utilization bound 
of 0.586 that can be obtained using worst-case analysis JSj |T]|. By exploiting 
this difference between the average case and the worst case behavior of the 
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deadline monotonic scheduling policy for aperiodic tasks, we can reduce power 
consumption for web servers without significant loss in temporal guarantees. 

7.2 Power control for web servers 

Many web services offer some delay bounds to clients as a part of the service 
level agreements; this is particularly true for services that require user fees. 
Moreover, web services offer multiple levels of service with better guarantees for 
premium customers. Synthetic utilization bounds are an effective mechanism 
to ensure that delay guarantees are met. Servers can use an admission control 
mechanism to ensure that they can limit the delay experienced by different 
clients. Alternatively, these bounds can be used to provision a web farm to 
ensure that all customer requirements can be met at low cost. 

Another application of such bounds is in operating power control. Most pro- 
cessors being manufactured today can operate at multiple clock speeds, with 
lower speeds consuming less power Thus, utilization bounds can help in deter- 
mining the ideal speed settings for processors such that delay bounds are not 
violated and power consumption is reduced. This approach was adopted by 
Sharma et al. [30], and is illustrative of the use of s5Tithetic utilization bounds. 
We will not stress the need for power control in server farms. The case has 
been made by many researchers including Sharma et al. [30]. The only goal of 
this section of our article is to suggest that using synthetic utilization thresholds 
will improve power savings at the cost of a small fraction of deadline violations. 
Sharma et al. used a sjTithetic utilization bound of 0.586 for the web server, 
while we allow the web server to operate up to a synthetic utilization of 0.75. 

Tasks are scheduled using the deadline monotonic priority assignment, there- 
fore different relative deadlines correspond to different service levels. We do 
not rewrite a web server like Apache to support multiple levels but, instead, run 
multiple instances of the Apache web server at different priority levels in the 
operating systerrj^ to provide service class differentiation. Our implementation 
is for the Linux operating system (Fedora Core 3; Linux kernel 2.6.9) and makes 
use of the TUX in-kernel web server [,29J to integrate admission control, power 
control and scheduling. 

All new HTTP session requests arrive and are processed by the TUX server 
Based on the source of the request (or other meta information), a service level 
- a delay guarantee, D, - is assigned for the request. The service time, c„ 
associated with a request is inferred from the content that is requested. If the 
new connection will not violate the synthetic utilization limit for the system (we 
chose 0.75), the request is admitted. The service time for a request depends on 
the processor speed. If, at the current speed, the utilization limit is exceeded 
then the power control module uses dynamic voltage scaling to increase the 
processor speed and keep the synthetic utilization under the limit. When the 
processor is operating at the maximum speed, new HTTP connections may be 

^Most operating systems including Linux allow users to set static priorities for tasks. Within each 
priority level, tasks are scheduled FIFO by default. 
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Figure 6: A system architecture for web services 



rejected to keep the system operating under the set hmit. Admitted sessions are 
handed off to the appropriate Apache server 

When a session terminates, it may be possible to reduce processor speed. We 
do not reduce the processor speed at once but v^fait for a predefined duration be- 
fore making changes. This is to minimize overhead from rapid voltage changes. 
To keep track of the synthetic utilization after connections have been admitted, 
we make use of the Netfilter framework and some extra modules that we im- 
plemented to track packets and identify HTTP traffic. The overall architecture 
of the web server platform (Figure [6]) is the same as the one used by Sharma et 
al. BOB and they have provided several implementation details that we do not 
discuss in this article but can be obtained from their report. The alterations we 
needed to make were only due to changes in the underlying platform. 

We used an Intel Pentium M processor with enhanced SpeedStep capability 
and a maximum processing speed of 1.7 GHz. The cpuf req driver for enhanced 
SpeedStep allows us to control the operating speed. The TUX in-kernel web 
server is part of the Linux Fedora Core 3 distribution. In contrast, Sharma et 
al. [I30II used an AMD Athlon processor with PowerNow DVS support. They also 
used Linux kernel 2.5, for which they needed to port khttpd, the in-kemel web 
server from Linux kernel 2.4j^The processor frequency and voltage settings for 
the processor we used are shown in Table [T] 

^There was a decision to remove the in-kernel web server between versions 2.4 and 2.5 of the 
Linux kernel, but the web server was brought back in to the 2.5 kernel by some distributions includ- 
ing Fedora. 
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Frequency Voltage 

MHz Volts 

~600 0956 
800 1.004 
1000 1.116 
1200 1.228 
1400 1.308 
1700 1.484 

Table 1: Frequency and voltage settings/Intel Pentium M 1.7GHz with enhanced 
SpeedStep 
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Figure 7: Impact of processor speed on execution times 

The workload requested by different clients was composed of a set of CGI 
scripts that would be executed at the web server We used 10 CGI scripts with 
varying degrees of computation. The execution time requirements of these 
scripts was determined by setting the processor speed at different levels and 
determining the maximum rate at which the processor could serve each CGI 
request. If, for example, at 1.7GHz, the server could handle 800 requests per 
second of script 1 alone, then the mean execution time of script 1 at this speed 
is 1 /800 = 1 .25ms. We profiled the scripts at each of the six possible speed set- 
tings to determine the change in execution times with slowdown. This type 
of profiling helps us account for other execution sources of overhead including 
data I/O. The throughput slowdown (and hence the execution time increase) 
for each of the 10 scripts is illustrated (Figure [7| the throughput at the high- 
est speed is assumed to be 1 and the throughput decrease at slower speeds is 
shown.) The scripts to the right of the graph are computationally more demand- 
ing and we use the slowdown/ speedup factors that correspond to these scripts 
when adjusting voltage levels. 

To determine power savings, we used logs of session-oriented connections 
that were fed to httperf 1.2 7 J to generate workload for the web server from 
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multiple clients. The workload we used contained 1000 persistent HTTP con- 
nections with random connection lengths chosen in the interval [2,16]. The 
requests could be for any of the profiled scripts and the inter-arrival time was 
drawn from an exponential distribution with different means. We created six 
Apache servers at different priority levels thus limiting the number of possible 
relative deadlines to six. 

There are two quantities of interest: the average power consumption and 
the fraction of deadlines missed. The average power consumption was obtained 
using a separate data acquisition system that measured the voltage drop across 
a sense resistor For the same workload, we determined the average power 
consumption when the synthetic utilization set point was 0.586 (the synthetic 
utilization bound) and 0.75 (near the sharp threshold). It is clear that we can 
obtain power savings, and these savings are shown in Figure [s] The load (along 
the jc-axis) is a fraction of the processor capacity based on the execution time 
profiling carried out earlier and the known inter-arrival times between HTTP 
requests. Increasing the load increases the maximum synthetic utilization. We 
varied the load from to 0.8 and observed that we can save an additional 10- 
11% energy by using a higher sjTithetic utilization set point. Using a set point 
of 0.586, we noted slightly less than 1.7% deadline misses and by raising the 
set point to 0.75 we recorded 2.8% deadline misses. Some deadline misses are 
inevitable, irrespective of the set point chosen unless we are overly conservative, 
because of variations in execution times and also depend on when exactly speed 
changes are performed. The encouraging result, however, is that we see greater 
power savings with a small penalty. 
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Figure 8: Energy savings: sharp threshold vs. tight bound 

By changing the synthetic utilization set-point from 0.586 to 0.75, a change of 
about 0.17, we would expect to see power savings of that magnitude at moder- 
ate and high workload conditions. This does not happen because of the discrete 
frequency-voltage settings, which often forces the processor to operate at higher 
speeds. Yet another question involves the selection of the synthetic utilization 
set point. From earlier experiments (Figure [s]), we could have picked a higher 




20 



set point, say 0.80. Even in the earlier experiments, the probabiHty of missing 
a deadHne is higher for a synthetic utiHzation of 0.80, and if we do use this for 
the web server system the percentage of jobs missing their deadHnes increased 
to 9%, which is significantly high. 

The essential takeaway from this section is that the existence of sharp thresh- 
olds allows us to improve the management of computer systems. With web 
servers, we can either reduce the energy costs or (quite naturally) deal with 
additional workload with existing infrastructure. 

8 Related work 

In our work, we explore some interesting aspects surrounding task set utiliza- 
tion and schedulability for real-time systems. There has been extensive work on 
deriving utilization bounds for periodic task systems starting with the work of 
Liu and Layland [23|. Kuo and Mok [IS] made significant improvements on Liu 
and Layland's bound for rate monotonic scheduling by showing that schedula- 
bility is a function, not of the number of individual tasks but, of the number of 
harmonic chains. Bini, Buttazzo and Buttazzo [5| have shown, using the hyper- 
bolic bound, that the feasible region for schedulability using the rate monotonic 
scheduling policy can be larger if the product of individual task utilizations (and 
not their sum) is bounded. Wu, Liu and Zhao used techniques inspired by net- 
work calculus to derive schedulability bounds [31 J for static priority scheduling. 
Their contribution is an alternative framework for deriving utilization bounds. 

Our work presents a fresh perspective on scheduling for real-time systems. 
Only Lehoczky, Sha and Ding [22J have attempted to obtain average-case re- 
sults. For rate monotonic scheduling, they characterized the breakdown utiliza- 
tion of the rate monotonic policy for the Liu and Layland model of real-time 
tasks as 0.88. Breakdown utilization, however, is not the same as a utilization 
threshold, and the connection between the two needs to be examined more 
closely. The methodology we employ in obtaining our results is new and ex- 
tremely general. It was not possible to reason in a rather abstract sense about 
the average-case behavior of scheduling policies with the more traditional anal- 
ysis techniques of time demand and resource supply. Furthermore, our ab- 
straction allows for reasoning about multi-stage and multiprocessor systems. 
Dutertre Il8]| identified phase transitions in a non-preemptive recurring task 
scheduling problem. While Dutertre's work emphasized the empirical evidence 
for sharp thresholds, we have provided the mathematical basis for the existence 
of sharp thresholds. 

Lehoczky pioneered the use of real-time queueing theory to predict the be- 
havior of real-time scheduling policies - specifically the earliest deadline first 
policy - under heavy traffic conditions with stochastic workload II20II21IL RTQT 
uses powerful tools to determine deadline miss percentages in end-to-end tasks 
executing on a resource pipeline. We may be able to use RTQT to predict the 
extent to which deadlines can be missed when a task set has utilization close to 
the threshold, but that requires extensive study, especially to extend RTQT to 
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static priority policies. 

In the realm of aperiodic task sets, great progress has been made recently, 
by Abdelzaher et al., with the identification of aperiodic schedulability bounds 
for static priority scheduling [ 1 1 . The initial result obtained by Abdelzaher and 
Lu [3 ] was a constant time utilization-based test for a set of aperiodic tasks. The 
original analysis has been extended to deal with end-to-end schedulability for 
multi-stage resource pipelines ||2l ■ It has also been shown that such analysis can 
be used to obtain non-utilization bounds for schedulability with static priority 
policies II24II . In this article, we have studied single-node thresholds for the 
aperiodic task model. In the future, we will further the ideas described in this 
article to include resource pipelines and non-utilization metrics. 

For the specific application of power control in web servers and web server 
clusters, there has been recent work by Bertini, Leite and Mosse [4|, and Hor- 
vath, Abdelzaher and Skadron [16]; we believe that the ideas proposed here 
can easily be integrated into these resource management solutions. 

Sharp thresholds are indicators of phase transitions. Phase transitions are 
common in physical systems. Freezing of ice and superconductivity are phe- 
nomena that have temperature as the critical parameter Phase transitions have 
been identified in many combinatorial optimization problems, especially con- 
straint satisfaction problems [71 |26l |T7|. Phase transitions provide very in- 
teresting insight into the behavior of combinatorial optimization problems, of 
which scheduling is an instance, and mayhold the key to faster, near-optimal 
solutions. Sharp thresholds for properties of random graphs were identified ini- 
tially by Erdos and Renyi HIOII and these results have been generalized by many 
mathematicians including Friedgut and Kalai [ll2[ I 111 . 

9 Conclusions 

The search for efficient tests for schedulability has been at the center of real-time 
systems research. We have generalized the use of utilization as a schedulability 
metric. By identifying the sharp threshold behavior of scheduling policies with 
respect to utilization, we provide a new test for schedulability. Schedulability 
tests using utilization thresholds are well-suited for soft real-time systems. For 
hard real-time systems these tests can be backed up by exact tests; thresholds 
can be used to perform initial filtering before using exact tests. 

Most scheduling policies can be shown to have sharp thresholds. We have 
introduced the task set graph abstraction that can be used to argue about the av- 
erage case behavior of policies irrespective of whether the workload is periodic 
or aperiodic. This abstraction is powerful enough to reason about uniprocessor 
scheduling, and we expect to apply the same ideas to multiprocessor and mul- 
tistage scheduling problems, and a variety of policies although we considered 
only the rate and deadline monotonic priority policies in this paper Interest- 
ingly, we have been able to use these thresholds to improve the energy efficiency 
of delay-sensitive web servers. 

Our approach to dealing with average or tj^ical case behavior of scheduling 
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policies makes interesting connections with results from percolation theory and 
random graphs. We hope to explore these links further to fully characterize 
the performance of scheduling policies. So far, we have been able to make 
some qualitative statements about scheduling policies but the ability to compare 
policies, which we have not explored with this framework, will enrich the graph- 
theoretic approach. 

There are several related open problems. The first of these is the determi- 
nation of the threshold for a policy without having to resort to experiments. 
Related to this is the secondary issue of determining the width of the threshold 
interval. The analysis is complex because of the time demand function that is 
needed to evaluate the completion time of a task. In a strictly periodic setting 
with rate monotonic scheduling, the completion time of a task t,-, L, is obtaining 
by fixed point iteration. 

!=1 ^' 

where the summation is taken over all tasks with priorities greater than or equal 
to the task t,. L < Pi is necessary and sufficient for t, to meet its deadline. 
We believe that developing some normal approximations will provide a better 
understanding of the threshold for the rate monotonic policy, as well as other 
policies. Another useful result would be a measure of the worst-case tardiness 
over all possible task sets when the utilization is known. When the utilization is 
less than the Liu and Layland bound [23 1, the tardiness is always zero but little 
is known about the worst possible tardiness for arbitrary utilization factors. 
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